Rewinding replacement television advertisements inserted by a smart television

ABSTRACT

A method is performed using a smart TV, which receives from a television signal source device a television signal feed encoding primary television content and then presents that content. The smart TV receives data via the computer network, including first data representing a to-be-replaced portion of the primary television content and second data representing secondary television content. Using the second data, the smart TV automatically presents the secondary television content in place of the to-be-replaced television content. The method includes the smart TV: (a) automatically monitoring, during presentation of the secondary television content, the television signal feed and comparing it with the first data; and (b) automatically altering presentation of the secondary television content in accordance with a user-control action with respect to the television signal source device, in response to detecting any difference between the television signal feed and the first data indicative of that user-control action.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of application Ser. No. 17/092,651,filed Nov. 9, 2020, now U.S. Pat. No. 11,503,348, which is acontinuation of application Ser. No. 16/016,448, filed Jun. 22, 2018,now U.S. Pat. No. 10,834,438, which is a continuation of applicationSer. No. 15/429,601, filed Feb. 10, 2017, now U.S. Pat. No. 10,009,636,which is a continuation of application Ser. No. 14/763,963, filed Jul.28, 2015, now U.S. Pat. No. 9,571,865, which is a U.S. National StageEntry filed under 35 U.S.C. § 371 of application PCT/US2014/013924,filed Jan. 30, 2014, which claims the benefit of U.S. application Ser.No. 13/754,639, filed Jan. 30, 2013, now U.S. Pat. No. 8,713,600.

BACKGROUND

The field of the present invention relates to targeted television adreplacement using a so-called “smart TV.” In particular, systems andmethods are disclosed herein for terminating or altering targetedtelevision ad replacement in response to a user-control action.

A goal of modern television advertising is targeted selection ofadvertisements for individual households or even for specific viewers inthose households. Numerous techniques and methodologies are availablefor (i) collecting user profile information from one or more sources(online or offline), (ii) using that profile information to select oneor more targeted advertisements, (iii) using the profile information toselect one or more programs or channels for presenting the targetedadvertisements, and (iv) correlating subsequent viewer actions afterpresenting the targeted advertisements. Some of these techniques andmethodologies are described in:

-   -   U.S. Pat. No. 7,861,260 entitled “Targeted television        advertisements based on online behavior” issued Dec. 28, 2010 to        Shkedi;    -   U.S. Pat. No. 8,566,164 entitled “Targeted online advertisements        based on viewing or interacting with television advertisements”        issued Oct. 22, 2013 in the names of Shkedi et al.;    -   U.S. Pat. No. 9,083,853 entitled “Targeted television        advertisements associated with online users' preferred        television programs or channels” issued Jul. 14, 2015 in the        name of Shkedi;    -   U.S. Pat. No. 8,051,444 entitled “Targeted television        advertisements selected on the basis of an online user profile        and presented with television programs or channels related to        that profile” issued Nov. 1, 2011 to Shkedi; and    -   U.S. Pat. No. 7,890,609 entitled “Requesting offline profile        data for online use in a privacy-sensitive manner” issued Feb.        15, 2011 to Shkedi.

Typically a targeted television advertisement is inserted into thestream of presented television content in place of a non-targetedadvertisement. A “targeted advertisement” refers to an advertisementshown to users based on taking into account user-specific profileinformation. A “non-targeted advertisement” refers to an advertisementshown to a large group of users without use of user-specific profileinformation; it may be “targeted” in a different sense, such as selectedbased on broad demographic characteristics, such as the demographiccharacteristics of users who watch a particular television program. Avariety of technological approaches are employed to achieve properinsertion of targeted television advertisements into the stream ofpresented television content.

In some cases, capabilities of a so-called “smart television” (i.e.,smart TV 100 shown in FIG. 1 ) are utilized to achieve insertion of thetargeted, replacement television advertisement in place of anon-targeted television advertisement. A smart television, like anyother television, has a connection to one or more television signalsource devices. Examples of television signal source devices 130 caninclude, but are not limited to: a digital antenna; a set-top box (STB)for cable, satellite, or Internet Protocol Television (IPTV); a digitalvideo recorder (DVR); a so-called entertainment-oriented device (EOD)such as a game console or a so-called “Over The Top” device (OTT;examples include Apple TV® or Roku®). Smart TV 100 receives fromtelevision signal source device 130 a television signal feed 200 thathas encoded thereon television content and presents via televisiondisplay 101 the encoded television content. Television content, as usedherein in any context, may comprise audio or video or both. Televisioncontent encoded in television signal feed 200 shall be referred toherein as the primary television content. The television content can beencoded into television signal feed 200 by television signal sourcedevice 130, or it can merely pass through that device already encoded.The primary television content can include programming of any sort(e.g., live, recorded, on-demand, broadcast, multicast, unicast, and soon). The primary television content often includes one or morenon-targeted or targeted television advertisements (broadcast,multicast, or unicast), which can be inserted by television signalsource device 130 or are already present in the primary televisioncontent by the time the television signal feed reaches that device. Anexample can include a STB uncompressing a broadcasted MPEG2 compressed720p television program into a 720p uncompressed format, which isdelivered from STB 130 to smart TV 100 via HDMI interface 135. Thetelevision program can include advertisements broadcasted as part of theprogram or advertisements inserted into the program by STB 130 (insteadof or in addition to the broadcasted ads).

As also seen in FIG. 1 , smart TV 100 also has its own connection 145 tocomputer network 140 through which smart TV 100 can be provided withonline access, e.g., access to the Internet. Smart TV 100 can receivetelevision content through computer network connection 145. Smart TV 100also includes one or more computer processors or processor cores 110 andone or more computer memories 120 (collectively referred to hereinafteras the “smart TV computer” or simply “computer” 160) that enable it toreceive, store, or process data or programming instructions. Such dataand programming can be employed, e.g., to enable smart TV 100 to receivetargeted television advertisements and to present them in place ofnon-targeted television advertisements that are part of the primarytelevision content.

An example of a conventional method for inserting a targeted televisionadvertisement into stream 200, shown in FIG. 2 , of primary televisioncontent can be performed as follows using computer network connection145 and smart TV computer 160. Smart TV 100 receives via computernetwork 140 electronic indicia of data representative of portions of theprimary television content. First data 103 represents the portion of theprimary television content intended to be replaced (e.g., typically anon-targeted advertisement; referred to as the “to-be-replaced content”or simply “replaced content” 203); other data 102 represents a portionof the primary television content that immediately precedes replacedcontent 203 (referred to as the “preceding content” 202; e.g., anotheradvertisement or a portion of programming content). Smart TV 100receives via computer network 140 electronic indicia of second data 105representative of secondary television content (e.g., typically atargeted advertisement; referred to as “replacement content” 205). Usingcomputer 160, smart TV 100 automatically (i) monitors the televisionsignal feed 200 it receives from television signal source 130 to detector otherwise determine the end of preceding content 202 and (ii)presents after preceding content 202, using second data 105, replacementcontent 205 instead of replaced content 203. Once replacement content205 is presented, smart TV 100 can revert to presentation of the primarytelevision content. In another example, smart TV 100 determines the endof preceding content 202 by identifying a signal or cue sent as part offeed 200. The signal or cue could be embedded in preceding content 202(such as in the last frame of preceding content 202 for example) or inthe gap between preceding content 202 and replaced content 203 or in thebeginning of replaced content 203.

In all cases discussed herein, data streams like first data 103 cancomprise a so-called “fingerprint” of one or more portions of theprimary television content (e.g., a digital video fingerprint generatedin any suitable way), a compressed digital encoding of one or moreportions of the primary television content, a raw, uncompressed encodingof one or more portions of the primary television content, or othersuitable representative data that enables smart TV 100 to identify thecorresponding television content in television signal feed 200 (i.e.,replaced 203 or preceding 202 content). If a fingerprint of the primarytelevision content is employed, it can be generated according to any oneof several known techniques or protocols. One example of a fingerprintof a segment of television content can rely on sampling within everyvideo frame of that segment of the television content. Smart TV 100, ora central server in possession of the segment samples, can compare thesamples of the segment with a sample taken by smart TV 100 fromtelevision signal feed 200. Based on that comparison, smart TV 100 orthe central server can recognize a specific frame within the segment.Likewise, the second data can comprise any suitable compressed oruncompressed encoding of the secondary television content (i.e.,replacement content 205). Different or parallel compression protocolscan be used for first 103 and second 105 data. If a fingerprint of theprimary television content is employed for first data 103, it can begenerated according to any one of several known techniques or protocols(one example can include taking a sample of audio, video, or both fromTV feed 200 and comparing it with an equivalent sample of knowncontent). A given fingerprint of television content can be generatedbased on both video and audio portions of that content, on the videoportion only, or on the audio portion only.

In some other examples (in which fingerprints are not employed oremployed partially), smart TV 100 receives via Internet 140 first 103 orsecond 105 data in, e.g., MPEG4 or other compressed format. Thecompressed format saves bandwidth so as to enable the paralleltransmission of a multitude of different targeted ads to a multitude ofcorresponding households watching television simultaneously. In oneexample, entire advertisements (not just portions; the preceding,replaced, and targeted advertisements) are sent to smart TV 100, whichthen uncompresses the three advertisements. The uncompressed precedingad 202 is compared with uncompressed television signal feed 200transmitted from STB 130, e.g., via HDMI. At the end of preceding ad202, uncompressed, targeted, replacement advertisement 205 is insertedby smart TV 100 in place of replaced advertisement 203. While presentingtargeted, replacement advertisement 205, smart TV 100 monitorstelevision signal feed 200 for changes in replaced advertisement 203 bycomparing feed 200 with replaced advertisement 203 received over theInternet 140. Alternatively, instead of comparing uncompressedtelevision signal feed 200 and received advertisements, smart TV 100instead can compress television signal feed 200 and do the comparisonsdescribed above using compressed television signal feed 200 and receivedadvertisements.

The example methods and systems described above create a technicalproblem relating to viewer control. Typically, television signal sourcedevice 130 mediates viewer control of the presentation of the primarytelevision content. Various user-control actions can be executed throughtelevision signal source device 130, whether by direct manipulation(e.g., pushing buttons on a STB), or by use of a remote control orauxiliary device 150 (e.g., a tablet or smartphone software applicationcontrolling the STB). Examples of user-control actions executed throughtelevision signal source device 130 can include a channel change or adisplay change.

A channel change denotes switching among multiple different streams ofdistinct broadcast, multicast, unicast, or locally stored televisioncontent that can be live, prerecorded, time-shifted, or on-demand. Adisplay change can include: (i) a so-called “trick mode” (e.g.: fastforward at various speeds such as 4×, 8×, 32×, or other; rewind or fastreverse at various speeds such as 4×, 8×, 32×, or other; pause orresume; or skipping forward or backward by various specified timeintervals, numbers of frames, or scenes); (ii) loop, repeat, or replay;(iii) slow motion or stop action; (iv) changing the zoom, stretch, oraspect ratio; (v) changing viewing angle or other 3D viewingparameter(s); (vi) changing between, e.g., “standard,” “movie,”“sports,” “game,” or other display presets; or (vii) changing backlight,contrast, brightness, color, tint sharpness, color temperature, or otherpicture quality parameters.

Such user-control actions, when executed through television signalsource device 130, affect television signal feed 200, which in turnaffects the presentation by smart TV 100 of the primary televisioncontent. In that capacity, smart TV 100 acts as a passive presentationdevice, becoming “active” (i.e., directly affecting the presentation oftelevision content) only when it presents a replacement advertisement orother replacement television content 205. Note that some display changescan also be executed using smart TV 100 (e.g., items (iv)-(vii) listedabove, or even items (i)-(iii) if smart TV 100 has sufficient memory 120or buffering capabilities), even when presenting television contentprovided by television signal source device 130 via television signalfeed 200. However, only those display changes executed throughtelevision signal source device 130 are considered for purposes of thepresent disclosure.

Because user-control actions, when executed through television signalsource device 130, affect only television signal feed 200 fromtelevision signal source device 130, such user-control actionsordinarily would have no discernible effect on any replacementtelevision content 205 being presented on smart TV display 101. In otherwords, in conventional techniques, if a viewer attempts to execute acontrol action during presentation of replacement content 205, thecontrol action would appear disabled. The control action indeed wouldaffect television signal feed 200 (fast forward, pause, etc.), butdisplay 101 would continue to show replacement content 205, undisturbedby the control action. This state of affairs (i.e., seeminglyineffectual user-control actions) would persist until replacementcontent 205 finished showing, at which time presentation would revert tothe primary television content (presumably modified, unbeknownst to theuser, in compliance with the intervening user-control actions, orperhaps just the last user-control action).

It would be desirable to provide systems and methods that mitigate theproblem described above.

SUMMARY

A method is performed using computer 160 associated with televisiondisplay 101 and connected to computer network 140 and to televisionsignal source device 130 (collectively, a so-called smart TV 100). SmartTV 100 receives from television signal source device 130 televisionsignal feed 200 having encoded thereon primary television content, andpresents the primary television content via television display 101.Computer 160 is programmed to utilize data received via computer network140, including (i) first data 103 comprising electronic indicia of ato-be-replaced portion 203 of the primary television content and (ii)second data 105 comprising electronic indicia of secondary televisioncontent 205. Computer 160 is programmed to present automatically viatelevision display 101, using second data 105, at least a portion ofsecondary television content 205 in place of the to-be-replacedtelevision content 203, see FIGS. 2 and 300 of FIG. 3 .

The method comprises: (a) during presentation of secondary televisioncontent 205, automatically monitoring, with computer 160, televisionsignal feed 200 and comparing it with the first data 103; and (b) inresponse to detecting any difference, between television signal feed 200and first data 103, indicative of a user-control action with respect totelevision signal source device 130, automatically altering, withcomputer 160, the presentation of secondary television content 205 inaccordance with the user-control action.

Objects and advantages pertaining to presenting replacement televisioncontent using a smart TV may become apparent upon referring to theembodiments disclosed in the following written description or outlinedin the appended claims.

This summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This Summary is not intended to identify key features oressential features of the claimed subject matter, nor is it intended tobe used as an aid in determining the scope of the claimed subjectmatter.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram of an embodiment of the smart TV showing itsconnection to an exemplary television signal source device and computernetwork.

FIG. 2 is a schematic diagram illustrating content replacement in anexemplary television signal feed.

FIG. 3 is a flow chart illustrating an exemplary method. claimed subjectmatter.

DETAILED DESCRIPTION OF EMBODIMENTS

In one or more of the illustrative embodiments disclosed herein, variousexamples of methods for inserting a targeted television advertisementinto a stream of primary television content can be performed as followsusing various examples of systems that include computer networkconnection 145 and computer 160 of smart TV 100. Parts of those methodsproceed substantially as described above.

In a first group of one or more embodiments, using computer 160 andfirst data 103, smart TV 100 automatically compares, as in 310 of FIG. 3, during presentation of replacement content 205 via smart TV 100,television signal feed 200 with first data 103 (representative ofreplaced content 203). Any detected discrepancy between televisionsignal feed 200 and first data 103 indicates that a user has performed auser-control action with respect to television signal source device 130.For example, if the user attempts a display change (e.g., a trick mode)or a channel change, first data 103 (indicative of replaced content 203at regular viewing speed), would no longer correspond to televisionsignal feed 200, because the user-control action would alter the signalfeed. If no such discrepancy is detected (indicating no user-controlaction was attempted) and presentation of replacement content 205finishes without any user-control action being taken, as in 330 of FIG.3 , then in some embodiments, presentation of television content viasmart TV 100 can, as in the conventional examples, simply revert topresentation of the primary television content. Depending on whetherreplaced content 203 is finished when replacement content 205 finishes,presentation may revert to an end portion of replaced content 203 or toa portion of the primary content immediately after replaced content 203(referred to as “succeeding content” 204).

If replacement television content 205 ends before replaced televisioncontent 203, an end portion of replaced television content 203 might bepresented after completion of replacement content 205. That may resultin a television presentation that may be jarring, confusing, or annoyingto viewers due to the abrupt and seemingly mysterious appearance of afragment of replaced content 203. In a second group of one or moreembodiments, if replacement content 205 reaches its end before the endof replaced content 203, smart TV 100 can present a black screen (or ablank screen of a different color, a user-selected color controlled by auser setting in the smart TV, or any other suitable filler material) tofill the gap between the end of replacement content 205 and the end ofreplaced content 203. A black screen can be used in countries where ablack screen identifies the end of one segment of television content andthe beginning of a succeeding segment of unrelated television content(e.g., a transition from a television program to a televisionadvertisement, from one television advertisement to another, or from atelevision advertisement to a television program). In countries where adifferent type of screen is used to identify the end of one segment ofcontent and the beginning of the next, that corresponding kind of screenwill be inserted as filler content by smart TV 100 to fill the gap fromthe end of replacement content 205 to the end of replaced content 203.In one example implementation of a black screen, smart TV 100 insertsthe black frames. When smart TV 100, using computer 160 and first data103, detects the end of replaced content 203 in television signal feed200 while presenting such filler content, it can then revertpresentation to the primary television content encoded in televisionsignal feed 200, providing the viewer with a smooth transition fromreplacement content 205 to succeeding content 204.

If, on the other hand, smart TV 100 does detect a discrepancy, in 320 ofFIG. 3 , between first data 103 (indicative of replaced content 203) andtelevision signal feed 200, that indicates that a user-control actionwas attempted. In a third group of one or more embodiments, in responseto detecting such a discrepancy, smart TV 100 automatically terminatespresentation of replacement content 205 and reverts to presentation ofreplaced content 203. That shift eliminates the misleading appearancethat the user-control action did not work, because smart TV 100discontinues presentation of replacement content 205 and the viewer cansee the effects of his or her control action on the resumed presentationof replaced content 203.

However, as with the case where replacement content 205 ends beforereplaced content 203 ends, this situation also results in presentationof television content that may appear jarring, confusing, or annoying toviewers due to the sudden switch, upon attempting to execute auser-control action, between different television advertisements. Anexception is the case wherein the user-control action is a channelchange; in that instance the abrupt appearance of different televisioncontent would be expected.

A fourth group of one or more embodiments help eliminate thepresentation problems described in the previous paragraphs. In responseto detecting, at 320 of FIG. 3 , a discrepancy between first data 103(representative of replaced content 203) and television signal feed 200,smart TV 100 can automatically, using computer 160 and first data 103,determine, as shown at 340 of FIG. 3 , what type of user-control actionhas been executed, e.g., fast forward, fast reverse, pause, or channelchange. Because the user-control action is done with respect totelevision signal source device 130, and not smart TV 100, determinationof the type of user-control action cannot typically be done directly.Instead, in 340 of FIG. 3 , smart TV 100 determines the user-controlaction by comparing first data 103 and television signal feed 200. Forexample, if first data 103 includes the video portion of replacedcontent 203, then smart TV 100 can compare the first data video with thevideo portion of television signal feed 200. A pause action on signalsource device 130 results in the freezing of the video on one particularframe. Smart TV 100 can identify the frozen frame by comparing the firstdata video frames with the signal feed frozen frame. The comparison canbe made between entire frames or between only sample sets of pixels ofeach frame. A fast forward action on signal source device 130 results inonly selected frames being sent in television signal feed 200 to smartTV 100 (the higher the fast forward rate, the fewer and further betweenare the selected frames sent to the smart TV). Smart TV 100 can comparewhole frames or sample pixels in the received signal feed frames withwhole frames or sample pixels in the first data to recognize theselected fast-forward rate (e.g., 4×, 8×, or 32× regular viewing speed).A fast reverse action on the signal source device can be identified in asimilar way. A channel change can be identified when smart TV 100 cannotfind a match between a frame of the video in television signal feed 200and a frame of the video in first data 103. The comparison of televisionsignal feed 200 and first data 103 typically is based on video forrecognizing a display change, including trick mode functionality such aspause, resume, fast forward, rewind, fast reverse, or skip. Forrecognizing a channel switch or the end of a replaced advertisement,audio or video or both can be used as a basis for comparison.Alternatively, smart TV 100 can determine the type of user-controlaction in those cases wherein television signal source device 130reports the type of user-control action to smart TV 100, for example viaa CEC (Consumer Electronics Control) connection over HDMI.

If the user-control action is a channel change, then smart TV 100 cansimply terminate presentation of replacement television content 205, see360 of FIG. 3 , and revert to presentation of replaced televisioncontent 203 encoded on television signal feed 200 (now altered due tothe channel change). As noted above, the abrupt appearance of differentpresented television content would be expected in that instance.

If smart TV 100 determines that the user-control action is a displaychange such as a trick mode, then, using computer 160 and second data105, smart TV 100 can alter presentation of replacement content 205, see350 of FIG. 3 , to substantially match the altered television signalfeed. For example, if a fast forward of replaced content 203 isdetected, then smart TV 100 can adjust presentation of replacementcontent 205 by fast-forwarding it in parallel (e.g., by skippingframes). Smart TV 100 can be programmed to mimic in its presentation ofreplacement content 205 the effect of various user-control displaychange actions on replaced content 203. The substitution of replacementcontent 205 for replaced content 203 therefore becomes “transparent” tothe viewer, who can no longer necessarily discern whether he or she isseeing the New television content (e.g., a non-targeted televisionadvertisement) versus replacement television content (e.g., a targetedtelevision advertisement). User-control actions (channel change ordisplay change) appear to function normally even if replacement content205 is being presented.

In a fifth group of one or more embodiments, after replacement content205 has been presented and its display completed, smart TV 100 can againinsert replacement content 205 if, for example, a rewind or fast reverseuser-control action is executed beginning from a time after theconclusion of replacement content 205. To accomplish this, the sequenceof steps described above can be executed again, with smart TV 100detecting succeeding content 204, presenting replacement content 205(possibly altered depending on user-control actions), monitoringtelevision signal feed 200 during a second presentation of replacementcontent 205, and terminating or altering the repeated presentation ofreplacement content 205 in response to a user-control action. A purposeof this technique is to allow the user to review replacement content 205after the succeeding television show (for example) resumes. Without thistechnique, if the user rewinds from a point after replacement content205 has been completed, the user would see replaced content 203 insteadof replacement content 205, and the user would not be able to findreplacement content 205. To enable such “rewinding” of replacementcontent 205, smart TV 100 receives electronic indicia of additional data104 that represents a portion of the primary television content thatimmediately follows replaced content 203 (i.e., succeeding content 204)or creates such additional data by itself, for example by fingerprintingsucceeding content 204 or simply recording it. Smart TV 100automatically monitors the rewound television signal feed 200 itreceives from television signal source 130 and compares it withadditional data 104 to detect or otherwise determine the beginning ofsucceeding content 204.

In some instances, the same replacement content 205 can be inserted eachtime replaced content 203 (or preceding content 202 or succeedingcontent 204) is detected by smart TV 100. In other instances, differentreplacement content can be inserted in place of replaced content 203;the choice of replacement content is part of the targeting process whenthe replacement content is a targeted advertisement. Any suitablesequence of replacement content can be employed for insertion in placeof a given portion of replaced content 203 upon repeated encounters withthat given portion. In one example, the same advertisement can bepresented each time the given portion of replaced content 203 isencountered (forward or backward). In another example, one advertisementcan be presented a number of times, followed by another advertisementpresented a number of times, and so on. In a third example, number ofdifferent advertisements can be rotated through one at a time at eachencounter with the replaced content. In a fourth example, eachreplacement advertisement is presented during only one encounter withthe given replacement content; at each subsequent encounter a newadvertisement is presented that has not been presented before.

In a sixth group of one or more embodiments, if the television contentthat includes the preceding and succeeding content 202, 204 is replayedat a later time (e.g., stored on a DVR or retrieved from an “on-demand”system), the same replacement content 205 can be presented each time theprimary content is replayed, or different replacement content can beselected than would be selected for the initial or earlier presentationsof the content. Subsequent replays can include still other replacementcontent. Any suitable variation, selection, or rotation of replacementcontent, including those described in the preceding paragraph, can beemployed.

The systems and methods disclosed herein can be implemented as generalor special purpose computers or servers or other programmable hardwaredevices programmed through software, or as hardware or equipment“programmed” through hard wiring, or a combination of the two. A“computer” (e.g., as in a “smart TV”) can comprise a single processor,processor core, or machine or can comprise multiple interactingprocessors, processor cores, or machines (located at a single locationor at multiple locations remote from one another). A computer memory orcomputer-readable medium can be encoded with a computer program, so thatexecution of that program by one or more computers causes the one ormore computers to perform one or more of the methods disclosed herein.Suitable media can include temporary or permanent storage or replaceablemedia, such as network-based or Internet-based or otherwise distributedstorage of software modules that operate together, RAM, ROM, CD ROM,CD-R, CD-R/W, DVD ROM, DVD±R, DVD±R/W, hard drives, thumb drives, flashmemory, optical media, magnetic media, semiconductor media, or anyfuture storage alternatives. Such encoded media can be preinstalledalready encoded in a smart TV during its manufacture, can be encodedafter installation into a smart TV during its manufacture, or can beencoded with “client” or “application” software copied or downloadedinto the smart TV after its manufacture. For example, client softwarecan be downloaded to the smart TV as part of occasional or periodicsoftware updates received by the smart TV, typically via its networkconnection.

In addition to the preceding, the following examples fall within thescope of the present disclosure or appended claims:

Example 1. A method performed using a computer associated with atelevision display and connected to a computer network and to atelevision signal source device, wherein: a television signal feedhaving encoded thereon primary television content is received from thetelevision signal source device and the primary television content ispresented via the television display; the computer is programmed toutilize data received via the computer network, including (i) first datacomprising electronic indicia of a to-be-replaced portion of the primarytelevision content and (ii) second data comprising electronic indicia ofsecondary television content; the computer is programmed to presentautomatically via the television display, using the second data, atleast a portion of the secondary television content in place of theto-be-replaced television content; and the method comprises: (a) duringpresentation of the secondary television content, automaticallymonitoring, with the computer, the television signal feed and comparingit with the first data; and (b) in response to detecting any difference,between the television signal feed and the first data, indicative of auser-control action with respect to the television signal source device,automatically altering, with the computer, the presentation of thesecondary television content in accordance with the user-control action.

Example 2. The method of Example 1 further comprising reverting topresentation of the primary television content after presenting thesecondary television content.

Example 3. The method of any preceding Example wherein (i) theuser-control action indicated by the detected difference between thetelevision signal feed and the first data is a channel change, and (ii)altering the presentation of the secondary television content comprisesterminating presentation of the secondary television content andresuming presentation of the primary television content.

Example 4. The method of any preceding Example wherein (i) theuser-control action indicated by the detected difference between thetelevision signal feed and the first data is a display change, and (ii)altering the presentation of the secondary television content comprisesaltering presentation of the secondary television content in a manneranalogous to the user-control action indicated by the detecteddifference between the television signal feed and the first data.

Example 5. The method of any preceding Example wherein (i) the primarytelevision content comprises one or more television programs and one ormore associated television advertisements, and (ii) the secondarytelevision content comprises one or more replacement televisionadvertisements.

Example 6. The method of any preceding Example further comprising, afterpresenting the secondary television content, automatically presentingfiller television content via the television display in place of an endportion of the to-be-replaced television content.

Example 7. The method of an preceding Example further comprising, afterpresenting the secondary television content and after a user-controlaction of rewinding or fast-reversing the primary television content toa point within or before the to-be-replaced television content, againautomatically presenting at least a portion of the secondary televisioncontent in place of the to-be-replaced television content.

Example 8. The method of any preceding Example further comprising: (c)after presenting the secondary television content and during latertime-shifted or on-demand presentation of the primary television contentvia the television display, automatically presenting different secondarytelevision content in place of the to-be-replaced television content;(d) during presentation of the different secondary television content,automatically monitoring, with the computer, the television signal feedand comparing it with the first data; and (e) in response to detectingany difference, between the television signal feed and the first data,indicative of a user-control action with respect to the televisionsignal source device, automatically altering, with the computer, thepresentation of the different secondary television content in accordancewith the user-control action.

Example 9. A smart TV comprising: a connection to a television signalsource device arranged so as to receive from the television signalsource a television signal feed having encoded thereon primarytelevision content; a television display structured and connected topresent the primary television content; a computer; and a connection toa computer network, wherein the computer is programed to perform themethod of any preceding Example.

Example 10. An article comprising a computer-readable medium in a smartTV or in a storage device controlled by a server connected to a computernetwork, which medium encodes computer-readable instructions that, whenapplied to a computer in a smart TV, instruct the computer to performthe method of any preceding Example.

It is intended that equivalents of the disclosed illustrativeembodiments and methods shall fall within the scope of the presentdisclosure or appended claims. It is intended that the disclosedillustrative embodiments and methods, and equivalents thereof, may bemodified while remaining within the scope of the present disclosure orappended claims.

In the foregoing Detailed Description, various features may be groupedtogether in several illustrative embodiments for the purpose ofstreamlining the disclosure. This method of disclosure is not to beinterpreted as reflecting an intention that any claimed embodimentrequires more features than are expressly recited in the correspondingclaim. Rather, as the appended claims reflect, inventive subject mattermay lie in less than all features of a single disclosed embodiment.Thus, the appended claims are hereby incorporated into the DetailedDescription, with each claim standing on its own as a separate disclosedembodiment. However, the present disclosure shall also be construed asimplicitly disclosing any embodiment having any suitable set of one ormore disclosed or claimed features (i.e., sets of features that are notincompatible or mutually exclusive) that appear in the presentdisclosure or the appended claims, including those sets that may not beexplicitly disclosed herein. In particular, any embodiment that fallswithin any one of the six groups of embodiments disclosed above, and anyembodiment that falls within any combination of two or more of those sixgroups of embodiments, shall be regarded as falling within the scope ofthe present disclosure or appended claims. Further, any embodimentexplicitly or implicitly disclosed herein can be implemented using anysuitable set of one or more known or future developed features,including but not limited to those disclosed in the Background. Itshould be further noted that the scope of the appended claims do notnecessarily encompass the whole of the subject matter disclosed herein.

For purposes of the present disclosure and appended claims, theconjunction “or” is to be construed inclusively (e.g., “a dog or a cat”would be interpreted as “a dog, or a cat, or both”; e.g., “a dog, a cat,or a mouse” would be interpreted as “a dog, or a cat, or a mouse, or anytwo, or all three”), unless: (i) it is explicitly stated otherwise,e.g., by use of “either . . . or,” “only one of,” or similar language;or (ii) two or more of the listed alternatives are mutually exclusivewithin the particular context, in which case “or” would encompass onlythose combinations involving non-mutually-exclusive alternatives. Forpurposes of the present disclosure or appended claims, the words“comprising,” “including,” “having,” and variants thereof, wherever theyappear, shall be construed as open ended terminology, with the samemeaning as if the phrase “at least” were appended after each instancethereof.

In the appended claims, if the provisions of 35 USC § 112 ¶6 are desiredto be invoked in an apparatus claim, then the word “means” will appearin that apparatus claim. If those provisions are desired to be invokedin a method claim, the words “a step for” will appear in that methodclaim. Conversely, if the words “means” or “a step for” do not appear ina claim, then the provisions of 35 USC § 112 ¶6 are not intended to beinvoked for that claim.

If any one or more disclosures are incorporated herein by reference andsuch incorporated disclosures conflict in part or whole with, or differin scope from, the present disclosure, then to the extent of conflict,broader disclosure, or broader definition of terms, the presentdisclosure controls. If such incorporated disclosures conflict in partor whole with one another, then to the extent of conflict, thelater-dated disclosure controls.

The Abstract is provided as required as an aid to those searching forspecific subject matter within the patent literature. However, theAbstract is not intended to imply that any elements, features, orlimitations recited therein are necessarily encompassed by anyparticular claim. The scope of subject matter encompassed by each claimshall be determined by the recitation of only that claim.

What is claimed is:
 1. A method of displaying rewound replacementtelevision content comprising: automatically with a computer that isassociated with a television display and that is coupled to receive froma television signal source device a television signal feed havingencoded therein primary television content and an original secondarytelevision content: (a) using Internet-received electronic indicia of areplacement secondary television content to cause presentation of thereplacement secondary television content via the television display, inplace of the original secondary television content; (b) after conclusionof the presentation of the replacement secondary television content viathe television display, using the television signal feed to causepresentation of a succeeding portion of the primary television contentvia the television display; (c) during presentation of the succeedingportion of the primary television content, comparing the televisionsignal feed with Internet-received electronic indicia of the succeedingportion of the primary television content and, in response to detectinga difference therebetween, which difference is indicative of a firstuser-control rewind action with respect to the television signal sourcedevice, and without receiving at the computer from the television signalsource device a signal representative of the rewind action, causingpresentation via the television display of the succeeding portion of theprimary television content in reverse; (d) after the reversedpresentation of the succeeding portion of the primary television contentreaches the beginning of the succeeding portion of primary televisioncontent, using the Internet-received electronic indicia of thereplacement secondary television content to cause presentation via thetelevision display of the replacement secondary television content, inreverse; and (e) comparing the television signal feed withInternet-received electronic indicia of the original secondarytelevision content and, in response to detecting a differencetherebetween, which difference is indicative of a second user-controlaction with respect to the television signal source device, and withoutreceiving at the computer from the television signal source device asignal representative of the second user-control action, causingpresentation via the television display of the replacement secondarytelevision content, altered in accordance with the second user-controlaction.
 2. The method of claim 1 wherein (i) the primary televisioncontent comprises a television program, (ii) the original secondarytelevision content comprises a first television advertisement, and (iii)the replacement secondary television content comprises a secondtelevision advertisement different from the first televisionadvertisement.
 3. The method of claim 1 wherein the first user-controlrewind action comprises a rewind command or fast-reverse command.
 4. Themethod of claim 1 wherein the second user-control action comprises aplay command.
 5. The method of claim 1 wherein (i) the computer and thetelevision display comprise a smart television, and (ii) the televisionsignal source device comprises a cable or satellite set-top box.
 6. Themethod of claim 1 wherein the comparing in part (c) is based on wholeframes.
 7. The method of claim 1 wherein the comparing in part (c) isbased on sample pixels.
 8. A smart television apparatus comprising: (a)a television display; (b) an Internet connection; (c) a connection to atelevision signal source device; and (d) a computer coupled to thetelevision display, coupled to the Internet connection, coupled to theconnection to the television signal source device to receive from atelevision signal source device a television signal feed having encodedtherein primary television content and an original secondary televisioncontent, which computer is programmed: (i) to, using Internet-receivedelectronic indicia of a replacement secondary television content,automatically cause presentation of the replacement secondary televisioncontent via the television display, in place of the original secondarytelevision content; (ii) to, after conclusion of the presentation of thereplacement secondary television content via the television display,automatically use the television signal feed to cause presentation of asucceeding portion of the primary television content via the televisiondisplay; (iii) to, during presentation of the succeeding portion of theprimary television content, automatically compare the television signalfeed with Internet-received electronic indicia of the succeeding portionof the primary television content and, in response to detecting adifference therebetween, which difference is indicative of a firstuser-control rewind action with respect to the television signal sourcedevice, and without receiving at the computer from the television signalsource device a signal representative of the rewind action, toautomatically cause presentation via the television display of thesucceeding portion of the primary television content in reverse; (iv)to, after the reversed presentation of the succeeding portion of theprimary television content reaches the beginning of the succeedingportion of primary television content, use the Internet-receivedelectronic indicia of the replacement secondary television content toautomatically cause presentation via the television display of thereplacement secondary television content, in reverse; and (v) toautomatically compare the television signal feed with Internet-receivedelectronic indicia of the original secondary television content and, inresponse to detecting a difference therebetween, which difference isindicative of a second user-control action with respect to thetelevision signal source device, and without receiving at the computerfrom the television signal source device a signal representative of thesecond user-control action, to automatically cause presentation via thetelevision display of the replacement secondary television content,altered in accordance with the second user-control action.
 9. The smarttelevision apparatus of claim 8 wherein (i) the primary televisioncontent comprises a television program, (ii) the original secondarytelevision content comprises a first television advertisement, and (iii)the replacement secondary television content comprises a secondtelevision advertisement different from the first televisionadvertisement.
 10. The smart television apparatus of claim 8 wherein thefirst user-control rewind action comprises a rewind command orfast-reverse command.
 11. The smart television apparatus of claim 8wherein the second user-control action comprises a play command.
 12. Thesmart television apparatus of claim 8 wherein the television signalsource device comprises a cable or satellite set-top box.
 13. The smarttelevision apparatus of claim 8 wherein, in part (d)(iii), the computerbeing programmed to automatically compare the television signal feedwith Internet-received electronic indicia of the succeeding portion ofthe primary television content comprises the computer being programmedto perform such automatic comparison based on whole frames.
 14. Thesmart television apparatus of claim 8 wherein, in part (d)(iii), thecomputer being programmed to automatically compare the television signalfeed with Internet-received electronic indicia of the succeeding portionof the primary television content comprises the computer beingprogrammed to perform such automatic comparison based on sample pixels.15. An article comprising a tangible computer-readable medium that isnot a transitory propagating signal, which medium encodescomputer-readable instructions that, when applied to a computer in asmart television apparatus containing a television display, which smarttelevision apparatus is coupled to receive from a television signalsource device a television signal feed having encoded therein primarytelevision content and an original secondary television content,instruct the computer to perform a method of automatically: (a) usingInternet-received electronic indicia of a replacement secondarytelevision content to cause presentation of the replacement secondarytelevision content via the television display, in place of the originalsecondary television content; (b) after conclusion of the presentationof the replacement secondary television content via the televisiondisplay, using the television signal feed to cause presentation of asucceeding portion of the primary television content via the televisiondisplay; (c) during presentation of the succeeding portion of theprimary television content, comparing the television signal feed withInternet-received electronic indicia of the succeeding portion of theprimary television content and, in response to detecting a differencetherebetween, which difference is indicative of a first user-controlrewind action with respect to the television signal source device, andwithout receiving at the computer from the television signal sourcedevice a signal representative of the rewind action, causingpresentation via the television display of the succeeding portion of theprimary television content in reverse; (d) after the reversedpresentation of the succeeding portion of the primary television contentreaches the beginning of the succeeding portion of primary televisioncontent, using the Internet-received electronic indicia of thereplacement secondary television content to cause presentation via thetelevision display of the replacement secondary television content, inreverse; and (e) comparing the television signal feed withInternet-received electronic indicia of the original secondarytelevision content and, in response to detecting a differencetherebetween, which difference is indicative of a second user-controlaction with respect to the television signal source device, and withoutreceiving at the computer from the television signal source device asignal representative of the second user-control action, causingpresentation via the television display of the replacement secondarytelevision content, altered in accordance with the second user-controlaction.
 16. The article of claim 15 wherein (i) the primary televisioncontent comprises a television program, (ii) the original secondarytelevision content comprises a first television advertisement, and (iii)the replacement secondary television content comprises a secondtelevision advertisement different from the first televisionadvertisement.
 17. The article of claim 15 wherein the firstuser-control rewind action comprises a rewind command or fast-reversecommand.
 18. The article of claim 15 wherein the second user-controlaction comprises a play command.
 19. The article of claim 15 wherein (i)the computer and the television display comprise a smart television, and(ii) the television signal source device comprises a cable or satelliteset-top box.
 20. The article of claim 15 wherein the comparing in part(c) is based on whole frames.
 21. The article of claim 15 wherein thecomparing in part (c) is based on sample pixels.